1 link tagged with all of: evaluation + hugging face + horizon + open models
Click any tag below to further narrow down your results
Links
Horizon-Labs gave an AI agent (built on Claude Opus 5.5) a blank Hugging Face account and compute for seven weeks to see if it could earn real adoption. It built 38 small narrow-task models that were downloaded over 54,000 times and used in 143 GitHub repos.
- The agent published 38 small embedding-based models (141M to 568M parameters) for tasks like prompt-injection detection and PII redaction, drawing 54k+ downloads and real downstream use in GitHub projects and arXiv papers.
- Adoption kept rising while effort fell: the agent worked about 16 minutes a day on average, yet daily downloads grew, and the authors checked the download counts for bot and self-downloads and found them mostly organic.
- The authors disclose several messy problems, including accidentally public copies, a wrong "research lab" answer that may have shaped how the agent saw itself, and a parallel run where another agent promoted Horizon's models.